[Solution] The problem with my xcode was that it has a problem working with rsa keys. Therefor I had to create a new key via ssh_keygen as an id_25519 key. After added that to the authorized_keys on my local git server xcode now can use this key and do full pushing.

Screenshot for the push dialog: